On the Support of Scientific Workflows over Pub/Sub Brokers
نویسندگان
چکیده
The execution of scientific workflows is gaining importance as more computing resources are available in the form of grid environments. The Publish/Subscribe paradigm offers well-proven solutions for sustaining distributed scenarios while maintaining the high level of task decoupling required by scientific workflows. In this paper, we propose a new model for supporting scientific workflows that improves the dissemination of control events. The proposed solution is based on the mapping of workflow tasks to the underlying Pub/Sub event layer, and the definition of interfaces and procedures for execution on brokers. In this paper we also analyze the strengths and weaknesses of current solutions that are based on existing message exchange models for scientific workflows. Finally, we explain how our model improves the information dissemination, event filtering, task decoupling and the monitoring of scientific workflows.
منابع مشابه
A Cloud-based Xml Publish/subscribe Service
XML message filtering and routing have been recognized as a standard for data exchange for XML dissemination services. These services are often realized using the Publish/Subscribe (pub/sub) model which is commonly used for various web-based systems. The conventional XML filtering and forwarding technique is an application-layer multicast approach that relies on XML-capable brokers that are bui...
متن کاملA Coordination and Discovery Service for QoS-enabled Data-Centric Publish/Subscribe in Wide Area Networks
A special class of Internet of Things called the Industrial Internet of Things (IIoT) operates in a large, distributed and dynamic environment comprising sensors all the way to large server clusters. A key requirement for IIoT is a scalable messaging service that supports multiple quality of service (QoS) properties, such as timeliness and resilience. Although existing pub/sub standards, such a...
متن کاملPubliyPrime: Exploiting Overlay Neighborhoods to Defeat Byzantine Publish/Subscribe Brokers
Publish/Subscribe (pub/sub) systems operating in hostile multi-domain environments face various types of internal and external threats. This paper focuses on internal threats manifested when pub/sub brokers misbehave by deviating from their prescribed protocol. Broker misbehavior may partially or fully compromise the pub/sub service integrity. In this paper, we exploit the notion of overlay nei...
متن کاملDistributed Event Aggregation for Publish/Subscribe Systems
Modern data-intensive applications handling massive event streams such as real-time traffic monitoring require support for both rich data filtering and aggregation capabilities. While the pub/sub communication paradigm provides an effective solution for the sought semantic diversity of event filtering, the event processing capabilities of existing pub/sub systems are restricted to singular even...
متن کاملTowards a Self-Adaptive Middleware for Building Reliable Publish/Subscribe Systems
Traditional publish/subscribe (pub/sub) systems may fail or cause longer message latency and higher computing resource usage in the presence of changes in the execution environment. We present the design and implementation of Mimosa Pudica, an adaptive and reliable middleware for adapting various changes in pub/sub systems. At the heart of Mimosa Pudica are two design ideas. First, the brokers ...
متن کامل